Metrics for Saliency Map Evaluation of Deep Learning Explanation Methods
نویسندگان
چکیده
Due to the black-box nature of deep learning models, there is a recent development solutions for visual explanations CNNs. Given high cost user studies, metrics are necessary compare and evaluate these different methods. In this paper, we critically analyze Deletion Area Under Curve (DAUC) Insertion (IAUC) proposed by Petsiuk et al. (2018). These were designed faithfulness saliency maps generated generic methods such as Grad-CAM or RISE. First, show that actual score values given map ignored only ranking scores taken into account. This shows insufficient themselves, appearance can change significantly without being modified. Secondly, argue during computation DAUC IAUC, model presented with images out training distribution which might lead unexpected behavior explained. To complement DAUC/IAUC, propose new quantify sparsity calibration explanation methods, two previously unstudied properties. Finally, give general remarks about studied in paper discuss how them study.
منابع مشابه
Explanation Methods in Deep Learning: Users, Values, Concerns and Challenges
Issues regarding explainable AI involve four components: users, laws & regulations, explanations and algorithms. Together these components provide a context in which explanation methods can be evaluated regarding their adequacy. The goal of this chapter is to bridge the gap between expert users and lay users. Different kinds of users are identified and their concerns revealed, relevant statemen...
متن کاملEvaluation of Deep Reinforcement Learning Methods for Modular Robots
We propose a novel framework for Deep Reinforcement Learning (DRL) in modular robotics using traditional robotic tools that extend state-of-the-art DRL implementations and provide an end-to-end approach which trains a robot directly from joint states. Moreover, we present a novel technique to transfer these DLR methods into the real robot, aiming to close the simulation-reality gap. We demonstr...
متن کاملDeep Learning for Saliency Prediction in Natural Video
The purpose of this paper is the detection of salient areas in natural video by using the new deep learning techniques. Salient patches in video frames are predicted first. Then the predicted visual fixation maps are built upon them. We design the deep architecture on the basis of CaffeNet implemented with Caffe toolkit. We show that changing the way of data selection for optimisation of networ...
متن کاملDeep Learning for Object Saliency Detection and Image Segmentation
In this paper, we propose several novel deep learning methods for object saliency detection based on the powerful convolutional neural networks. In our approach, we use a gradient descent method to iteratively modify an input image based on the pixel-wise gradients to reduce a cost function measuring the class-specific objectness of the image. The pixel-wise gradients can be efficiently compute...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Lecture Notes in Computer Science
سال: 2022
ISSN: ['1611-3349', '0302-9743']
DOI: https://doi.org/10.1007/978-3-031-09037-0_8